Weather Profiling

Dataset statistics

Number of variables	21
Number of observations	155159
Missing cells	1058290
Missing cells (%)	32.5%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	24.9 MiB
Average record size in memory	168.0 B

Variable types

NUM	14
CAT	6
DATE	1

Warnings

`wind_spd` has a high cardinality: 2124 distinct values	High cardinality
`pct_possible` has a high cardinality: 102 distinct values	High cardinality
`wind_chill` is highly correlated with `temp`	High correlation
`temp` is highly correlated with `wind_chill`	High correlation
`sta_press` is highly correlated with `sea_lvl_press` and 1 other fields	High correlation
`sea_lvl_press` is highly correlated with `sta_press` and 1 other fields	High correlation
`altimeter_setting` is highly correlated with `sea_lvl_press` and 1 other fields	High correlation
`file_name` is highly correlated with `site` and 1 other fields	High correlation
`site` is highly correlated with `file_name`	High correlation
`year` is highly correlated with `file_name`	High correlation
`dew_pt` has 18320 (11.8%) missing values	Missing
`rH` has 18376 (11.8%) missing values	Missing
`heat_idx` has 152201 (98.1%) missing values	Missing
`wind_chill` has 96191 (62.0%) missing values	Missing
`wind_dir` has 7972 (5.1%) missing values	Missing
`hr_precip` has 120618 (77.7%) missing values	Missing
`snow_depth` has 68084 (43.9%) missing values	Missing
`snowfall_3hr` has 69198 (44.6%) missing values	Missing
`snowfall_6hr` has 69547 (44.8%) missing values	Missing
`snowfall_24hr` has 69801 (45.0%) missing values	Missing
`sea_lvl_press` has 87974 (56.7%) missing values	Missing
`sta_press` has 70210 (45.3%) missing values	Missing
`altimeter_setting` has 70210 (45.3%) missing values	Missing
`solar_radiation` has 69794 (45.0%) missing values	Missing
`pct_possible` has 69794 (45.0%) missing values	Missing
`hr_precip` is highly skewed (γ1 = 63.53586536)	Skewed
`snowfall_3hr` is highly skewed (γ1 = 26.91591115)	Skewed
`snowfall_6hr` is highly skewed (γ1 = 22.47496747)	Skewed
`hr_precip` has 30738 (19.8%) zeros	Zeros
`snow_depth` has 5364 (3.5%) zeros	Zeros
`snowfall_3hr` has 55831 (36.0%) zeros	Zeros
`snowfall_6hr` has 54240 (35.0%) zeros	Zeros
`snowfall_24hr` has 51275 (33.0%) zeros	Zeros
`solar_radiation` has 42637 (27.5%) zeros	Zeros

Reproduction

Analysis started	2023-01-06 16:02:20.418501
Analysis finished	2023-01-06 16:02:53.875947
Duration	33.46 seconds
Software version	pandas-profiling v2.9.0
Download configuration	config.yaml

dt
Date

Distinct	70602
Distinct (%)	45.5%
Missing	0
Missing (%)	0.0%
Memory size	1.2 MiB

Minimum	2007-01-01 00:00:00
Maximum	2021-12-31 23:00:00

Histogram

Histogram with fixed size bins (bins=50)

temp
Real number (ℝ)

HIGH CORRELATION

Distinct	144
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	36.41926024
Minimum	-42
Maximum	106
Zeros	367
Zeros (%)	0.2%
Memory size	1.2 MiB

Quantile statistics

Minimum	-42
5-th percentile	9
Q1	23
median	33
Q3	49
95-th percentile	72
Maximum	106
Range	148
Interquartile range (IQR)	26

Descriptive statistics

Standard deviation	19.58854766
Coefficient of variation (CV)	0.537862316
Kurtosis	0.0766972782
Mean	36.41926024
Median Absolute Deviation (MAD)	12
Skewness	0.2922759327
Sum	5650776
Variance	383.7111994
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
32	4374	2.8%
30	4230	2.7%
28	4080	2.6%
31	4046	2.6%
27	3986	2.6%
29	3985	2.6%
33	3806	2.5%
26	3802	2.5%
25	3569	2.3%
24	3435	2.2%
Other values (134)	115846	74.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-42	2	< 0.1%
-41	6	< 0.1%
-39	1	< 0.1%
-38	2	< 0.1%
-35	1	< 0.1%

Value	Count	Frequency (%)
106	1	< 0.1%
104	2	< 0.1%
102	1	< 0.1%
101	2	< 0.1%
100	5	< 0.1%

dew_pt
Real number (ℝ)

MISSING

Distinct	153
Distinct (%)	0.1%
Missing	18320
Missing (%)	11.8%
Infinite	0
Infinite (%)	0.0%

Mean	26.53768297
Minimum	-76
Maximum	101
Zeros	400
Zeros (%)	0.3%
Memory size	1.2 MiB

Quantile statistics

Minimum	-76
5-th percentile	3
Q1	18
median	27
Q3	37
95-th percentile	49
Maximum	101
Range	177
Interquartile range (IQR)	19

Descriptive statistics

Standard deviation	15.34902156
Coefficient of variation (CV)	0.5783858967
Kurtosis	3.949791731
Mean	26.53768297
Median Absolute Deviation (MAD)	9
Skewness	-1.019069054
Sum	3631390
Variance	235.5924629
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
26	4375	2.8%
28	4235	2.7%
30	4188	2.7%
24	4122	2.7%
25	4072	2.6%
32	4057	2.6%
23	3877	2.5%
20	3755	2.4%
22	3667	2.4%
19	3658	2.4%
Other values (143)	96833	62.4%
(Missing)	18320	11.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-76	2	< 0.1%
-75	2	< 0.1%
-74	4	< 0.1%
-73	4	< 0.1%
-72	11	< 0.1%

Value	Count	Frequency (%)
101	1	< 0.1%
75	1	< 0.1%
74	5	< 0.1%
73	6	< 0.1%
72	6	< 0.1%

rH
Real number (ℝ_≥0)

MISSING

Distinct	100
Distinct (%)	0.1%
Missing	18376
Missing (%)	11.8%
Infinite	0
Infinite (%)	0.0%

Mean	73.1108398
Minimum	1
Maximum	100
Zeros	0
Zeros (%)	0.0%
Memory size	1.2 MiB

Quantile statistics

Minimum	1
5-th percentile	29
Q1	55
median	81
Q3	93
95-th percentile	99
Maximum	100
Range	99
Interquartile range (IQR)	38

Descriptive statistics

Standard deviation	23.39028427
Coefficient of variation (CV)	0.3199290876
Kurtosis	-0.5048161741
Mean	73.1108398
Median Absolute Deviation (MAD)	15
Skewness	-0.7702044401
Sum	10000320
Variance	547.1053981
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
100	5725	3.7%
94	5237	3.4%
95	4951	3.2%
96	4924	3.2%
92	4776	3.1%
93	4439	2.9%
97	4254	2.7%
91	3959	2.6%
90	3900	2.5%
98	3774	2.4%
Other values (90)	90844	58.5%
(Missing)	18376	11.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	149	0.1%
2	225	0.1%
3	183	0.1%
4	107	0.1%
5	51	< 0.1%

Value	Count	Frequency (%)
100	5725	3.7%
99	3130	2.0%
98	3774	2.4%
97	4254	2.7%
96	4924	3.2%

heat_idx
Real number (ℝ_≥0)

MISSING

Distinct	29
Distinct (%)	1.0%
Missing	152201
Missing (%)	98.1%
Infinite	0
Infinite (%)	0.0%

Mean	82.83400947
Minimum	78
Maximum	201
Zeros	0
Zeros (%)	0.0%
Memory size	1.2 MiB

Quantile statistics

Minimum	78
5-th percentile	79
Q1	80
median	82
Q3	84
95-th percentile	89
Maximum	201
Range	123
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	4.16856112
Coefficient of variation (CV)	0.05032427075
Kurtosis	220.3628771
Mean	82.83400947
Median Absolute Deviation (MAD)	2
Skewness	8.828742129
Sum	245023
Variance	17.37690181
Monotocity	Not monotonic

Histogram with fixed size bins (bins=29)

Value	Count	Frequency (%)
80	558	0.4%
81	471	0.3%
82	376	0.2%
79	309	0.2%
83	275	0.2%
84	225	0.1%
85	183	0.1%
86	148	0.1%
87	106	0.1%
88	98	0.1%
Other values (19)	209	0.1%
(Missing)	152201	98.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
78	15	< 0.1%
79	309	0.2%
80	558	0.4%
81	471	0.3%
82	376	0.2%

Value	Count	Frequency (%)
201	1	< 0.1%
110	1	< 0.1%
107	1	< 0.1%
104	4	< 0.1%
102	2	< 0.1%

wind_chill
Real number (ℝ)

HIGH CORRELATION
MISSING

Distinct	111
Distinct (%)	0.2%
Missing	96191
Missing (%)	62.0%
Infinite	0
Infinite (%)	0.0%

Mean	16.10161443
Minimum	-70
Maximum	42
Zeros	652
Zeros (%)	0.4%
Memory size	1.2 MiB

Quantile statistics

Minimum	-70
5-th percentile	-10
Q1	8
median	18
Q3	26
95-th percentile	37
Maximum	42
Range	112
Interquartile range (IQR)	18

Descriptive statistics

Standard deviation	15.06432757
Coefficient of variation (CV)	0.9355787044
Kurtosis	2.398416701
Mean	16.10161443
Median Absolute Deviation (MAD)	9
Skewness	-1.127472988
Sum	949480
Variance	226.9339652
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
16	2183	1.4%
19	2085	1.3%
18	1949	1.3%
21	1936	1.2%
22	1897	1.2%
14	1883	1.2%
24	1755	1.1%
11	1638	1.1%
10	1629	1.0%
23	1609	1.0%
Other values (101)	40404	26.0%
(Missing)	96191	62.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-70	1	< 0.1%
-69	1	< 0.1%
-68	1	< 0.1%
-67	1	< 0.1%
-65	1	< 0.1%

Value	Count	Frequency (%)
42	110	0.1%
41	353	0.2%
40	360	0.2%
39	916	0.6%
38	856	0.6%

wind_dir
Categorical

MISSING

Distinct	16
Distinct (%)	< 0.1%
Missing	7972
Missing (%)	5.1%
Memory size	1.2 MiB

WSW	32999
SW	26696
SSW	14553
NW	13111
W	10370
Other values (11)	49458

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
WSW	32999	21.3%
SW	26696	17.2%
SSW	14553	9.4%
NW	13111	8.5%
W	10370	6.7%
WNW	9544	6.2%
NE	5835	3.8%
S	5601	3.6%
NNE	5347	3.4%
N	5036	3.2%
Other values (6)	18095	11.7%
(Missing)	7972	5.1%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	3
Median length	3
Mean length	2.372798226
Min length	1

wind_spd
Categorical

HIGH CARDINALITY

Distinct	2124
Distinct (%)	1.4%
Missing	0
Missing (%)	0.0%
Memory size	1.2 MiB

0G0	4984
1G4	3514
1G3	3031
2G6	2399
1G5	2355
Other values (2119)	138876

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
0G0	4984	3.2%
1G4	3514	2.3%
1G3	3031	2.0%
2G6	2399	1.5%
1G5	2355	1.5%
2G7	2346	1.5%
2G5	2209	1.4%
0G2	2017	1.3%
2G8	1899	1.2%
3G8	1840	1.2%
Other values (2114)	128565	82.9%

Frequencies of value counts

Unique

Unique	660 ?
Unique (%)	0.4%

Histogram of lengths of the category

Length

Max length	6
Median length	4
Mean length	3.985808107
Min length	1

hr_precip
Real number (ℝ_≥0)

MISSING
SKEWED
ZEROS

Distinct	49
Distinct (%)	0.1%
Missing	120618
Missing (%)	77.7%
Infinite	0
Infinite (%)	0.0%

Mean	0.007582003995
Minimum	0
Maximum	19.58
Zeros	30738
Zeros (%)	19.8%
Memory size	1.2 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0.02
Maximum	19.58
Range	19.58
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.2425489193
Coefficient of variation (CV)	31.99008065
Kurtosis	4329.938167
Mean	0.007582003995
Median Absolute Deviation (MAD)	0
Skewness	63.53586536
Sum	261.89
Variance	0.05882997826
Monotocity	Not monotonic

Histogram with fixed size bins (bins=49)

Value	Count	Frequency (%)
0	30738	19.8%
0.01	1735	1.1%
0.02	739	0.5%
0.03	384	0.2%
0.04	260	0.2%
0.05	176	0.1%
0.06	135	0.1%
0.07	76	< 0.1%
0.08	57	< 0.1%
0.09	49	< 0.1%
Other values (39)	192	0.1%
(Missing)	120618	77.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	30738	19.8%
0.01	1735	1.1%
0.02	739	0.5%
0.03	384	0.2%
0.04	260	0.2%

Value	Count	Frequency (%)
19.58	1	< 0.1%
17.75	1	< 0.1%
17.53	1	< 0.1%
16.48	1	< 0.1%
15.64	1	< 0.1%

snow_depth
Real number (ℝ_≥0)

MISSING
ZEROS

Distinct	1157
Distinct (%)	1.3%
Missing	68084
Missing (%)	43.9%
Infinite	0
Infinite (%)	0.0%

Mean	24.00705369
Minimum	0
Maximum	149.6
Zeros	5364
Zeros (%)	3.5%
Memory size	1.2 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	4.1
median	12.2
Q3	35.7
95-th percentile	77.9
Maximum	149.6
Range	149.6
Interquartile range (IQR)	31.6

Descriptive statistics

Standard deviation	26.58475153
Coefficient of variation (CV)	1.107372519
Kurtosis	1.635547209
Mean	24.00705369
Median Absolute Deviation (MAD)	10.8
Skewness	1.409922921
Sum	2090414.2
Variance	706.7490138
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	5364	3.5%
0.1	873	0.6%
0.3	847	0.5%
0.2	692	0.4%
2.5	613	0.4%
0.4	609	0.4%
0.5	454	0.3%
3	428	0.3%
2	425	0.3%
2.6	417	0.3%
Other values (1147)	76353	49.2%
(Missing)	68084	43.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	5364	3.5%
0.1	873	0.6%
0.2	692	0.4%
0.3	847	0.5%
0.4	609	0.4%

Value	Count	Frequency (%)
149.6	5	< 0.1%
149.5	14	< 0.1%
149.4	1	< 0.1%
149.3	6	< 0.1%
149.2	27	< 0.1%

snowfall_3hr
Real number (ℝ_≥0)

MISSING
SKEWED
ZEROS

Distinct	341
Distinct (%)	0.4%
Missing	69198
Missing (%)	44.6%
Infinite	0
Infinite (%)	0.0%

Mean	0.5219925315
Minimum	0
Maximum	149.5
Zeros	55831
Zeros (%)	36.0%
Memory size	1.2 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0.2
95-th percentile	1.9
Maximum	149.5
Range	149.5
Interquartile range (IQR)	0.2

Descriptive statistics

Standard deviation	4.329892409
Coefficient of variation (CV)	8.294931724
Kurtosis	825.1669677
Mean	0.5219925315
Median Absolute Deviation (MAD)	0
Skewness	26.91591115
Sum	44871
Variance	18.74796828
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	55831	36.0%
0.1	5510	3.6%
0.2	3839	2.5%
0.3	2769	1.8%
0.4	2316	1.5%
0.5	1776	1.1%
0.6	1450	0.9%
0.7	1246	0.8%
0.8	1138	0.7%
0.9	876	0.6%
Other values (331)	9210	5.9%
(Missing)	69198	44.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	55831	36.0%
0.1	5510	3.6%
0.2	3839	2.5%
0.3	2769	1.8%
0.4	2316	1.5%

Value	Count	Frequency (%)
149.5	2	< 0.1%
149.4	2	< 0.1%
149.3	2	< 0.1%
149.1	4	< 0.1%
148.8	1	< 0.1%

snowfall_6hr
Real number (ℝ_≥0)

MISSING
SKEWED
ZEROS

Distinct	380
Distinct (%)	0.4%
Missing	69547
Missing (%)	44.8%
Infinite	0
Infinite (%)	0.0%

Mean	0.7085466991
Minimum	0
Maximum	149.5
Zeros	54240
Zeros (%)	35.0%
Memory size	1.2 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0.3
95-th percentile	2.6
Maximum	149.5
Range	149.5
Interquartile range (IQR)	0.3

Descriptive statistics

Standard deviation	5.451384955
Coefficient of variation (CV)	7.693755348
Kurtosis	560.0450366
Mean	0.7085466991
Median Absolute Deviation (MAD)	0
Skewness	22.47496747
Sum	60660.1
Variance	29.71759793
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	54240	35.0%
0.1	4340	2.8%
0.2	3305	2.1%
0.3	2478	1.6%
0.4	2173	1.4%
0.5	1719	1.1%
0.6	1520	1.0%
0.7	1335	0.9%
0.8	1201	0.8%
0.9	996	0.6%
Other values (370)	12305	7.9%
(Missing)	69547	44.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	54240	35.0%
0.1	4340	2.8%
0.2	3305	2.1%
0.3	2478	1.6%
0.4	2173	1.4%

Value	Count	Frequency (%)
149.5	2	< 0.1%
149.4	1	< 0.1%
149.3	5	< 0.1%
149.1	1	< 0.1%
148.9	1	< 0.1%

snowfall_24hr
Real number (ℝ_≥0)

MISSING
ZEROS

Distinct	409
Distinct (%)	0.5%
Missing	69801
Missing (%)	45.0%
Infinite	0
Infinite (%)	0.0%

Mean	1.257981677
Minimum	0
Maximum	149.1
Zeros	51275
Zeros (%)	33.0%
Memory size	1.2 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0.7
95-th percentile	4.5
Maximum	149.1
Range	149.1
Interquartile range (IQR)	0.7

Descriptive statistics

Standard deviation	7.816349717
Coefficient of variation (CV)	6.213405059
Kurtosis	286.8508598
Mean	1.257981677
Median Absolute Deviation (MAD)	0
Skewness	16.26845858
Sum	107378.8
Variance	61.0953229
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	51275	33.0%
0.1	2652	1.7%
0.2	2351	1.5%
0.3	1997	1.3%
0.4	1921	1.2%
0.5	1496	1.0%
0.6	1378	0.9%
0.7	1264	0.8%
0.8	1204	0.8%
0.9	973	0.6%
Other values (399)	18847	12.1%
(Missing)	69801	45.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	51275	33.0%
0.1	2652	1.7%
0.2	2351	1.5%
0.3	1997	1.3%
0.4	1921	1.2%

Value	Count	Frequency (%)
149.1	6	< 0.1%
149	2	< 0.1%
148.8	4	< 0.1%
148.7	3	< 0.1%
148.6	31	< 0.1%

site
Categorical

HIGH CORRELATION

Distinct	6
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.2 MiB

SNSLP	68084
JVEMT	17853
S11MT	17818
MRPMT	17424
SH7MT	17291

Frequencies
Length

Value	Count	Frequency (%)
SNSLP	68084	43.9%
JVEMT	17853	11.5%
S11MT	17818	11.5%
MRPMT	17424	11.2%
SH7MT	17291	11.1%
SH4MT	16689	10.8%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	5
Median length	5
Mean length	5
Min length	5

file_name
Categorical

HIGH CORRELATION

Distinct	28
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.2 MiB

SNSLP-2016.html	8764
JVEMT-2020.html	8724
S11MT-2020.html	8710
SNSLP-2017.html	8558
MRPMT-2020.html	8362
Other values (23)	112041

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
SNSLP-2016.html	8764	5.6%
JVEMT-2020.html	8724	5.6%
S11MT-2020.html	8710	5.6%
SNSLP-2017.html	8558	5.5%
MRPMT-2020.html	8362	5.4%
SH7MT-2020.html	8324	5.4%
SNSLP-2020.html	7822	5.0%
SH4MT-2020.html	7750	5.0%
SNSLP-2019.html	7563	4.9%
SH4MT-2021.html	7312	4.7%
Other values (18)	73270	47.2%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	15
Median length	15
Mean length	15
Min length	15

year
Categorical

HIGH CORRELATION

Distinct	13
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.2 MiB

2020	49692
2021	42086
2019	16560
2016	8764
2017	8558
Other values (8)	29499

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
2020	49692	32.0%
2021	42086	27.1%
2019	16560	10.7%
2016	8764	5.6%
2017	8558	5.5%
2018	7139	4.6%
2008	6214	4.0%
2007	5591	3.6%
2014	3536	2.3%
2011	2040	1.3%
Other values (3)	4979	3.2%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	4
Median length	4
Mean length	4
Min length	4

sea_lvl_press
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	12847
Distinct (%)	19.1%
Missing	87974
Missing (%)	56.7%
Infinite	0
Infinite (%)	0.0%

Mean	962.4523845
Minimum	762.09
Maximum	1176.42
Zeros	0
Zeros (%)	0.0%
Memory size	1.2 MiB

Quantile statistics

Minimum	762.09
5-th percentile	774.92
Q1	956.99
median	1011.07
Q3	1022.07
95-th percentile	1073.31
Maximum	1176.42
Range	414.33
Interquartile range (IQR)	65.08

Descriptive statistics

Standard deviation	105.5316795
Coefficient of variation (CV)	0.1096487278
Kurtosis	-0.6366816303
Mean	962.4523845
Median Absolute Deviation (MAD)	15.32
Skewness	-1.004717144
Sum	64662363.45
Variance	11136.93538
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1015.46	86	0.1%
1015.12	72	< 0.1%
1011.92	68	< 0.1%
1016	67	< 0.1%
1015.8	60	< 0.1%
1018.16	59	< 0.1%
1017.89	59	< 0.1%
1016.34	58	< 0.1%
1019	58	< 0.1%
1012.26	57	< 0.1%
Other values (12837)	66541	42.9%
(Missing)	87974	56.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
762.09	1	< 0.1%
762.27	1	< 0.1%
762.44	1	< 0.1%
762.6	1	< 0.1%
763.21	2	< 0.1%

Value	Count	Frequency (%)
1176.42	1	< 0.1%
1174.67	1	< 0.1%
1173.97	1	< 0.1%
1173.91	1	< 0.1%
1173.03	1	< 0.1%

sta_press
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	537
Distinct (%)	0.6%
Missing	70210
Missing (%)	45.3%
Infinite	0
Infinite (%)	0.0%

Mean	22.44570837
Minimum	0
Maximum	25.71
Zeros	2
Zeros (%)	< 0.1%
Memory size	1.2 MiB

Quantile statistics

Minimum	0
5-th percentile	17.77
Q1	22.73
median	23.17
Q3	24.31
95-th percentile	24.85
Maximum	25.71
Range	25.71
Interquartile range (IQR)	1.58

Descriptive statistics

Standard deviation	2.433299229
Coefficient of variation (CV)	0.1084082172
Kurtosis	-0.03609955493
Mean	22.44570837
Median Absolute Deviation (MAD)	1.02
Skewness	-1.158871617
Sum	1906740.48
Variance	5.920945137
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
23.17	1608	1.0%
23.14	1555	1.0%
23.1	1365	0.9%
23.2	1346	0.9%
23.07	1338	0.9%
23.24	1292	0.8%
23.27	1283	0.8%
23.04	1245	0.8%
17.89	1152	0.7%
17.92	1087	0.7%
Other values (527)	71678	46.2%
(Missing)	70210	45.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2	< 0.1%
17.37	3	< 0.1%
17.38	1	< 0.1%
17.39	2	< 0.1%
17.4	5	< 0.1%

Value	Count	Frequency (%)
25.71	1	< 0.1%
25.7	2	< 0.1%
25.67	2	< 0.1%
25.66	1	< 0.1%
25.57	1	< 0.1%

altimeter_setting
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	690
Distinct (%)	0.8%
Missing	70210
Missing (%)	45.3%
Infinite	0
Infinite (%)	0.0%

Mean	28.68547234
Minimum	0
Maximum	33.35
Zeros	2
Zeros (%)	< 0.1%
Memory size	1.2 MiB

Quantile statistics

Minimum	0
5-th percentile	23.05
Q1	29.44
median	29.95
Q3	30.14
95-th percentile	31.5
Maximum	33.35
Range	33.35
Interquartile range (IQR)	0.7

Descriptive statistics

Standard deviation	2.853638608
Coefficient of variation (CV)	0.09948027261
Kurtosis	0.2569864934
Mean	28.68547234
Median Absolute Deviation (MAD)	0.24
Skewness	-1.336042908
Sum	2436802.19
Variance	8.143253308
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
30.02	1217	0.8%
30.04	1210	0.8%
30.06	1200	0.8%
30.03	1186	0.8%
29.99	1184	0.8%
30.01	1126	0.7%
30.05	1119	0.7%
30	1106	0.7%
29.97	1090	0.7%
30.07	1070	0.7%
Other values (680)	73441	47.3%
(Missing)	70210	45.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2	< 0.1%
22.53	3	< 0.1%
22.55	1	< 0.1%
22.56	2	< 0.1%
22.57	5	< 0.1%

Value	Count	Frequency (%)
33.35	1	< 0.1%
33.33	2	< 0.1%
33.3	2	< 0.1%
33.29	1	< 0.1%
33.17	1	< 0.1%

solar_radiation
Real number (ℝ_≥0)

MISSING
ZEROS

Distinct	987
Distinct (%)	1.2%
Missing	69794
Missing (%)	45.0%
Infinite	0
Infinite (%)	0.0%

Mean	133.8078252
Minimum	0
Maximum	1067
Zeros	42637
Zeros (%)	27.5%
Memory size	1.2 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	1
Q3	181
95-th percentile	678
Maximum	1067
Range	1067
Interquartile range (IQR)	181

Descriptive statistics

Standard deviation	222.0364803
Coefficient of variation (CV)	1.659368426
Kurtosis	2.294663077
Mean	133.8078252
Median Absolute Deviation (MAD)	1
Skewness	1.805046887
Sum	11422505
Variance	49300.19857
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	42637	27.5%
2	339	0.2%
3	313	0.2%
5	294	0.2%
1	294	0.2%
4	294	0.2%
6	264	0.2%
11	260	0.2%
12	240	0.2%
8	235	0.2%
Other values (977)	40195	25.9%
(Missing)	69794	45.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	42637	27.5%
1	294	0.2%
2	339	0.2%
3	313	0.2%
4	294	0.2%

Value	Count	Frequency (%)
1067	1	< 0.1%
1056	1	< 0.1%
1024	1	< 0.1%
1020	2	< 0.1%
1009	1	< 0.1%

pct_possible
Categorical

HIGH CARDINALITY
MISSING

Distinct	102
Distinct (%)	0.1%
Missing	69794
Missing (%)	45.0%
Memory size	1.2 MiB

--	42637
100 %	1097
10 %	819
13 %	817
8 %	809
Other values (97)	39186

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
--	42637	27.5%
100 %	1097	0.7%
10 %	819	0.5%
13 %	817	0.5%
8 %	809	0.5%
5 %	801	0.5%
9 %	783	0.5%
11 %	776	0.5%
17 %	756	0.5%
7 %	751	0.5%
Other values (92)	35319	22.8%
(Missing)	69794	45.0%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	5
Median length	3
Mean length	2.971583988
Min length	2

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

First rows

	dt	temp	dew_pt	rH	heat_idx	wind_chill	wind_dir	wind_spd	snow_depth	snowfall_3hr	snowfall_6hr	snowfall_24hr	site	file_name	year	sea_lvl_press	sta_press	altimeter_setting	solar_radiation	pct_possible
0	2021-12-31 23:00:00	-12.0	-16.0	80.0	NaN	NaN	E	2G5	18.9	0.0	0.0	0.0	JVEMT	JVEMT-2021.html	2021	NaN	NaN	NaN	NaN	NaN
1	2021-12-31 22:00:00	-10.0	-14.0	81.0	NaN	NaN	E	2G5	18.7	0.0	0.0	0.0	JVEMT	JVEMT-2021.html	2021	NaN	NaN	NaN	NaN	NaN
2	2021-12-31 21:00:00	-7.0	-11.0	82.0	NaN	NaN	E	2G5	19.1	0.0	0.1	0.0	JVEMT	JVEMT-2021.html	2021	NaN	NaN	NaN	NaN	NaN
3	2021-12-31 20:00:00	-5.0	-9.0	81.0	NaN	NaN	E	1G3	19.1	0.0	0.1	0.0	JVEMT	JVEMT-2021.html	2021	NaN	NaN	NaN	NaN	NaN
4	2021-12-31 19:00:00	-2.0	-7.0	79.0	NaN	NaN	E	1G3	19.1	0.1	0.1	0.0	JVEMT	JVEMT-2021.html	2021	NaN	NaN	NaN	NaN	NaN
5	2021-12-31 18:00:00	-1.0	-7.0	75.0	NaN	NaN	E	1G3	19.1	0.1	0.1	0.0	JVEMT	JVEMT-2021.html	2021	NaN	NaN	NaN	NaN	NaN
6	2021-12-31 17:00:00	0.0	-7.0	72.0	NaN	NaN	ENE	1G6	19.2	0.2	0.1	0.0	JVEMT	JVEMT-2021.html	2021	NaN	NaN	NaN	NaN	NaN
7	2021-12-31 16:00:00	1.0	-10.0	58.0	NaN	NaN	E	5G11	19.0	0.0	0.0	0.0	JVEMT	JVEMT-2021.html	2021	NaN	NaN	NaN	NaN	NaN
8	2021-12-31 15:00:00	1.0	-12.0	55.0	NaN	-12.0	E	7G15	19.0	0.0	0.0	0.0	JVEMT	JVEMT-2021.html	2021	NaN	NaN	NaN	NaN	NaN
9	2021-12-31 14:00:00	1.0	-11.0	56.0	NaN	-12.0	ESE	7G14	19.0	0.0	0.0	0.5	JVEMT	JVEMT-2021.html	2021	NaN	NaN	NaN	NaN	NaN

Last rows

	dt	temp	dew_pt	rH	heat_idx	wind_chill	wind_dir	wind_spd	hr_precip	snowfall_24hr	site	file_name	year	sea_lvl_press	sta_press	altimeter_setting	solar_radiation	pct_possible
155149	2019-10-16 04:00:00	48.0	NaN	NaN	NaN	NaN	SW	15G31	NaN	NaN	MRPMT	MRPMT-2019.html	2019	NaN	24.70	29.94	NaN	NaN
155150	2019-10-16 03:00:00	48.0	NaN	NaN	NaN	NaN	SW	14G29	NaN	NaN	MRPMT	MRPMT-2019.html	2019	NaN	24.70	29.95	NaN	NaN
155151	2019-10-16 02:00:00	49.0	NaN	NaN	NaN	NaN	SW	14G29	NaN	NaN	MRPMT	MRPMT-2019.html	2019	NaN	24.70	29.94	NaN	NaN
155152	2019-10-16 01:00:00	49.0	NaN	NaN	NaN	NaN	SW	15G31	NaN	NaN	MRPMT	MRPMT-2019.html	2019	NaN	24.70	29.94	NaN	NaN
155153	2019-10-16 00:00:00	49.0	NaN	NaN	NaN	NaN	SW	13G30	NaN	NaN	MRPMT	MRPMT-2019.html	2019	NaN	24.70	29.94	NaN	NaN
155154	2019-10-15 23:00:00	49.0	NaN	NaN	NaN	NaN	SW	14G31	NaN	NaN	MRPMT	MRPMT-2019.html	2019	NaN	24.69	29.93	NaN	NaN
155155	2019-10-15 22:00:00	49.0	NaN	NaN	NaN	NaN	SW	13G29	NaN	NaN	MRPMT	MRPMT-2019.html	2019	NaN	24.70	29.95	NaN	NaN
155156	2019-10-15 21:00:00	48.0	NaN	NaN	NaN	NaN	SW	10G25	NaN	NaN	MRPMT	MRPMT-2019.html	2019	NaN	24.72	29.97	NaN	NaN
155157	2019-10-15 20:00:00	48.0	NaN	NaN	NaN	NaN	SSW	10G19	NaN	NaN	MRPMT	MRPMT-2019.html	2019	NaN	24.74	29.99	NaN	NaN
155158	2019-10-15 19:00:00	48.0	NaN	NaN	NaN	NaN	SW	10G20	NaN	NaN	MRPMT	MRPMT-2019.html	2019	NaN	24.75	30.01	NaN	NaN

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows